On the scalability and convergence of simultaneous 
parameter identification and synchronization of 
dynamical systems 



The synchronization of dynamical systems is a method that allows 
two systems to have identical state trajectories, appart from an error 
converging to zero. This method consists in an appropriate unidirec- 
tional coupling from one system (drive) to the other (response). This 
requires that the response system shares the same dynamical model 
with the drive. For the cases where the drive is unknown, Chen 
proposed in 2002 a method to adapt the response system such that 
synchronization is achieved, provided that (1) the response dynamical 
model is linear with a vector of parameters, and (2) there is a param- 
eter vector that makes both system dynamics identical. However, this 
method has two limitations: first, it does not scale well for complex 
parametric models (e.g., if the number of parameters is greater than 
the state dimension), and second, the model parameters are not guar- 
anteed to converge, namely as the synchronization error approaches 
zero. This paper presents an adaptation law addressing these two 
limitations. Stability and convergence proofs, using Lyapunov's sec- 
ond method, support the proposed adaptation law. Finally, numerical 
simulations illustrate the advantages of the proposed method, namely 
showing cases where the Chen's method fail, while the proposed one 
does not. 

1 Introduction 

Consider two identical continuous time dynamical systems, designated drive 
(D) and response (R). It is well known that the state evolution of each 
system, when taken separately, may differ radically if the initial condition 
for each system differ, namely in the case of chaotic dynamical systems J6j 
H]. However, in the presence of a unidirectional coupling from the drive to 
the response system, synchronization of their state trajectories is known to 
occur pill El E] . In this paper we limit the discussion to the simplest coupling 
scheme, in which the response system receives the full state vector from the 
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drive. In this situation it is easy to design a controller that synchronizes 
both systems, using feedback linearization (Section [2]). 

Such synchronization assumes that both drive and response have the 
same dynamical model. This paper addresses the problem of achieving syn- 
chronization of a response system, when the dynamical model of the drive 
is unknown. In particular, we target the problem of simultaneous adap- 
tation and synchronization of a response system, given an unknown drive. 
Two assumptions are made: (1) the response dynamical model depends lin- 
early on a parameter vector, and (2) there is a value for this vector that 
makes both systems identical. In 2002, Chen and Lii proposed a method 
to simultaneously adapt this parameter vector and to make both systems 
synchronized [3] . Lyapunov second method was used to prove the feasibility 
of this method, however, due to the construction of the Lyapunov function 
employed, convergence of the response parameters is not guaranteed. This 
has two consequences that prevent the general usage of this method. Firstly, 
it does not scale in complexity: if the dimension of the parameter vector is 
greater than the dimension of the state vector, convergence is not guaran- 
teed. And secondly, even with a small number of parameters, Chen's proof 
does not guarantee effective convergence of the parameters. 

In this paper we address both of these problems, presenting a convergence 
proof for the simultaneous synchronization and adaptation of the response 
to an arbitrary drive system. Moreover, numerical simulations comparing 
the proposed approach with Chen's method illustrate the benefits of the 
approach. 

Chaotic synchronization was first introduced by Pecora and Carrol in 
1990 [7J. Since then, many publications have deepend our knowledge about 
this concept [U [5j [H [2]. A method for synchronizing the Rossler and 
the Chen chaotic systems using active control was proposed by Agiza and 
Yassen [2], however the approach is specific to these particular systems. 
Chen and Lii proposed a method to perform simultaneous identification and 
synchronization of chaotic systems |3], but the results show some limitations, 
which are discussed in length and addressed in this paper. 

The paper is structured a follows: section [2] states formally the problem, 
followed by the proposed solution in section [3j experimental results are 
presented in section |4j and section [5] concludes the paper. 

2 Problem statement 

Consider two dynamical systems, called drive and response, with a unidi- 
rectional coupling between them. Throughout this paper we will assume 
that both drive and response systems are identical, apart from a parameter 
vector, which is unknown. The goal of the adaptation law is to determine 
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this parameter vector. Consider the drive system modeled by 

x = f(x)+F(x)9, (1) 

where x(t) G 1" is the state vector, and 9 6 M m is a parameter vector. 
The nonlinear functions that support the model are / : W 1 —> M n and 
F : W n — > IR( nxm ). The coupling between the drive and the response systems 
consists in a bias term, called synchronization input, from the drive to the 
response. The response system is identical to the drive, except for the 
parameter vector a E M. m and the synchronization input U, 

i, = f(y) + F(y)a + U(y,x,a), (2) 

where y(t) £ 1™ is the response state vector, and U : M. n x M. n x M. m — > M n is 
the synchronization control function. This function U realizes the controller 
that, given the state input from the drive, synchronizes the response system. 

Define the state error e = y — x and the parameter error A = a — 9; the 
simultaneous adaptation and synchronization problem consists in the design 
of a controller U and of a parameter adaptation law for a such that both 
lim^oo e(t) = and lim^oo A(t) = 0. 

Chen proposes in [3] a solution to this problem in the form of an adap- 
tation law for a. 

Assumption 1. There is a controller U and a scalar function V(e) that, 
for a = 6, satisfies both (i) ci||e|| 2 < V(e) < C2 1 1 e 1 1 2 and (ii) V(e) < 
—W(e), for c\,C2 positive constants, W(e) a positive definite function, and 
U(x, x, u, 9) = 0. 

For example, the controller 

U(y, x, 9) = -e + f(x) - f(y) + [F(x) - F(y)} 9, (3) 
and the function V(e) = \e T e satisfy this assumption. 
Theorem 1. Under Assumption 1, the adaptation law 

a = -F T (x) [gradT/(e)] T (4) 
stabilizes the system at the equilibrium point e = 0, a = 9. 
Proof See [3]. □ 
In the proof of this theorem, Chen employs the Lyapunov function 

V l (e,a)= 1 2 e T e+ l 2 A T A. (5) 

There is an hidden assumption in the proof: it only holds if U(y, x, a) — 
U (y, x, 9) = [F(x) — F(y)] A (which is true if controller ^ is used). 
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Still, two problems remain that compromise the applicability of this re- 
sult. The first one is that Q does not guarantee strict definite positiveness 
of —Vi; in particular, V\(0,a) = for all values of a. This means that, as 
the synchronization error e approaches zero, the magnitude of the param- 
eter error A is not guaranteed to decrease. The second problem concerns 
the null space of F T (x): according to Q, the parameter vector a remains 
changed, as long as gradl^(e) lies in the null space of F T (x). Taking for 
instance V(e) = ^e T e, while the state error e lies in this null space, the 
parameter vector a remains unchanged, even if a ^ 9. 

3 Proposed solution 

Let us first obtain a controller function U that achieves synchronization, 
assuming that the true value of the parameter vector is known, a = 9. In 
this situation, the error state e has the following dynamics 

e = f(y) - f{x) + [F(y) - F(x)} 9 + U(y, x, 9). (6) 

Considering now the positive definite Lyapunov function 

V(e) = \ e T e, (7) 

its time derivative is V = e T e. Taking the controller 

U(y, X ,9) = -Ke- f(y) + f(x) - [F(y) - F(x)\ 9, (8) 

where K is a (n x n) positive definite matrix, we have that e = —Ke. Ma- 
trix K is thus related with the synchronization rate. Since — V = e T K e is 
a positive definite function, for a positive definite K, system ^ is globally 
uniformly asymptotically stable at the equilibrium point e = 0. Note 
that this controller satisfies Chen's Assumption referred in the previous sec- 
tion. 

Consider now the positive definite Lyapunov function 

V(e,A) = ±e T e + ±A T A. (9) 

This function is zero if and only if both the response is synchronized with 
the drive, and its parameters equal the drive ones. The dynamics of the 
error e, while using the controller ([8]), is then 

e = -Ke + F(x)A. (10) 

By left multiplying this equation by F T (x) L, where L is a (n x n) positive 
definite matrix (which is related with the adaptation rate; see below), and 
transposing the result, one gets the relation 

A T F T (x) L T F(x) = e T L T F(x) + e T K T L T F(x). (11) 

We are now in condition to prove the main result of this paper: 
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Theorem 2. Assuming that there is a constant matrix L such that G{x) = 
F T (x) L T F(x) is positive definite for all x, the adaptation law 

a = -F T (x)[(LK + I) e + Le], (12) 

together with the controller pL globally uniformly stabilizes both the error 



system (10) at e = 0, and the parameter error at A = 0. 



Proof. Considering the Lyapunov function ([9]), we have V = e T e + A T A. 
Taking the adaptation law ( 12 ) together with (|ll|), while noting that A = a, 
one obtains 

V = —e T K e — A T G{x)A. (13) 

Since G(x) is assumed positive definite, — V is also positive definite, from 
which we can conclude that (e, A) = (0, 0) is a globally uniformly asymp- 



totically stable [TT] equilibrium point of (10). □ 



This theorem implies both synchronization (y = x) and correct identifi- 
cation of the parameters (a = 9). Note that the practical use of the proposed 



adaptation law (12) requires knowledge of the error time derivative e, which 
in principle can be obtained (or estimated) from the error evolution. 

The choice of the constant matrices K and L have impact on the conver- 
gence rate. If a = 9, the error system is e = —Ke, meaning that the error 
decreases asymptotically to zero according to a first-order linear dynamics 
with a time constant determined by K. If e = 0, the parameter error has 
the dynamics A = —F T (x) L F(x) A, and thus the magnitude of L impacts 
on the convergence rate of the parameters. Simple choices for K and L are 
diagonal matrices with constant values, K = k I and L = 1 1, for k and / 
two positive scalars. Thus, the state and parameter error dynamics become 
e = -k e and A = —l F T (x) F(x) A. 

Since F(x) is a (n x m) matrix, its rank is lower or equal to min(n,m), 
and thus the rank of G{x) is also lower and equal to min(n, m). However, 
in order for G(x) to be positive definite, its rank has to be equal to m 
(the dimension of the parameter vector 9), and thus n > m is a necessary 
condition for G(x) to be full rank. This means that there is an upper bound 
to the amount or parameters m, in order for convergence to be guaranteed. 
This largely limits the flexibility of the response system to adapt to arbitrary 
drive systems, in particular with a large amount of parameters. 

To tackle this problem we propose augmenting the F(x) matrix with 
extra rows, as many as needed, in order for G(x) to become full rank. First, 
let us designate by x*(t) a new state vector consisting in the concatenation 
of time delayed versions of the original state vector x(t), 

x* = [x xi • • • x r ] T , (14) 
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where Xi(t) = x(t — i 5), for i = 1 . . . r and a 5 > 0. Using this state vector, 
the drive system becomes 



where 



f*(x* 



x * = f*( x *)+F*(x*)9, 
f(x ) 



f(Xr 



and 



F*(x*) 



F(x ) 

F(x r ) 



(15) 



(16) 



This augmented system is equivalent to ([!]) , as the additional state dimension 
corresponds to time delayed versions of the original system. The response 
system, with state vector y* £ ]&( r + 1 ') n takes the form 



y 



f*(y*) + F*(y*) a + U*(y*,x*,a) 



(17) 



These two coupled systems (15) and (17) with state vectors x* and y* can 



be viewed as a new pair of drive and response systems by themselves, with 
error vector e* = y* — x* . Thus, the results obtained above can be directly 
applied here: the synchronization controller becomes 

U*(y*,x\ a) = —K* e* - f*(y*) + f*(x*) - [F*(y*) - F*(x*)} a, (18) 

where the matrix K* can be a ((r + l)n x (r + l)n) block diagonal formed 
by K matrices, 





' K 








K* = 





K 
















The adaptation law becomes then 



-F* T (x*) [(L* K* + I) e* + L* e* 



(19) 



(20) 



where L* is a ((r + l)n x (r + l)n) matrix, which can also take the form of 
a block diagonal in the same fashion as K* above, 





' L 








L* = 





L 







_ 








(21) 



If both K* and L* have the block diagonal structure as in (19) and (21) 



the adaptation law (20) can be simplified into 



a = -Y J F T {x l )[(LK + I)e i + e i ], (22) 
i=0 

where ej = yi — xi and = iji — x j . 

With the above augmented system, we can prove convergence when n < 
m with the following Corollary: 
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Corollary 1. If matrix G*(x) = (F*)(x) T (L*) T F*(x) is full rank for all 
x, then the response system (17), together with the adaptation law (20), 
globally uniformly stabilizes both the error system (10) at e = 0, and the 
parameter error at A = 0. 



Proof. The equivalent drive (15) and the response (17) systems satisfy the 
conditions of Theorem [2j as long as G* (x) is full rank. □ 

The rank of G* (x) cannot be guaranteed a priori, but a necessary condition 
Corollary can still be stated: 



Corollary 2. // F has rank n < m, then r > \' L 
condition for G* to be full rank. 



1] is a necessary 



Proof. The rank of G* = (F*) T (L*) T F* is at most min[(r + l)n, m). Since 
G* is a m x m matrix, in order to be full rank, (r + l)n > m has to hold. 
Therefore, r > ? — 1, but since r is an integer, its lower bound is — 1] . □ 

In general, as r is arbitrary, one can expect that there is a value of r large 
enough that makes G* full rank. 



Comparing the obtained adaptation law (22) with (12) above, one can 



observe that the gradient of the parameters depends on several time delayed 
samples of the error e (as well as on their derivatives e). A possible intuition 
to this result comes from the observation that, if m > n, the degrees of 
freedom of e are not enough to produce a meaningful gradient for a, if the 



law (12) is employed. However, with (22), which depends on e* with (r+l)n 
degrees of freedom, the gradient of a can have the full dimensionality of m. 



4 Experimental results 



This section presents numerical results illustrating the theoretical results 
derived above. Two classical chaotic systems were used: the Lorenz os- 
cillator [12], commonly used in the chaotic synchronization literature for 
numerical simulations [5j |3], and the Rossler attractor, designed to be- 
have similarly to the Lorenz system while being easier to understand [9]. 
Simultaneous identification and synchronization is simulated, while com- 
paring the performance of Chen's method [3] with the one proposed here. 
For the Chen's method we used controller Q with the adaptation law (4]), 
and for our method we used controller ( |18[ ) with the adaptation law ([22). 

The Lorenz oscillator is a three-dimensional dynamical system that be- 
haves chaotically for a certain set of parameters [12] . In the form of ([!]), it 
can be written as 
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Figure 1: Lorenz system: graph of parameter identification results for a^. 
Solid line: Chen's method Q, dotted and dash-dotted lines: proposed 
method (22) for r = 3 and for r = 5. 



where x, y and z are state variables and 0\, 62 and #3 are system parameters. 
The Lorenz oscillator was synchronized with a response system, which is 
specified by four parameters. In the form of ([2]), it can be written as 



(24) 



where u, v and w are state variables and oti, ct2, 03 and «4 are the param- 
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eters. Note that the rank of the F(x) matrix in (24) is at most 3, while the 



response systems uses 4 parameters: «4 is an unnecessary parameter that 



is not present in the drive (23), being artificially introduced to comparing 
the two approaches when m > n. As it was shown before, under these 
conditions Chen's method is not guaranteed to converge, while Corollary [2] 
requires r > 1 for G* to be full rank, and thus a necessary condition for 
convergence (as Corollary [TJ . 

For this simulation, the classical parameter values for the Lorenz sys- 
tem were used: [0 1 , 6 2 , 3 , 6> 4 ] T = [10, 28, 8/3, 0] T . The initial states of the 
drive system and the controlled system were arbitrarily set to [8, 9, 10] T 
and [3, 4, 5] T , respectively. The parameters of the response system had zero 
initial condition. The L and K parameters were set to 10/ and 0.17. 
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Figure 2: Lorenz system: graph of parameter identification results for a\ 
using Chen's method Q. 
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Figure 3: Lorenz system: plot of parameter identification results for a%. Top 
plot: Chen's method Q, middle and bottom plots: proposed method (22) 
for r = 3 and for r = 5. 
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Figure 4: Lorenz system: graph of Lyapunov function for synchronization 
error. Top plot: Chen's method Q, bottom plot: proposed method (22) for 
r = 3. 



Figure [jj shows the numerical result^j of parameter identification for pa- 
rameter 04. Note the trend for the parameter convergence to be faster for 
higher values of r. Figure [2] shows the results of parameter identification 
for the parameter 04 for Chen's method over a longer time horizon. While 
Chen's method is not able to identify this parameter even after 1000 seconds, 
our method allows for a significantly faster convergence (under 200 seconds). 
Figure [3] shows the results of parameter identification for 03. Table [4] shows 
the time it takes for the parameter identification error to fall below a per- 
centage of the real parameter value. Note again that the convergence is 
faster for higher values of r. It is interesting to note that, for instance, 
during the last 20 seconds of the simulation, the coefficient of variation^] of 
the root mean square error is of 4.42 x 10~ 3 for Chen's method, while for 
our method it is of 1.21 x 10~ 4 (r = 3) and 1.36 x 10" 6 (r = 5). Chen's 
method is not able to correctly identify this parameter, with its value oscil- 
lating around the true value of #3. Our method, however, allows for a lower 
variance in the parameter identification. Figure [4] shows the synchroniza- 
tion error, as measured by the Lyapunov function Q. Both Chen's method 
and ours are able to drive the synchronization error to zero. Our method, 
however, shows near-instantaneous convergence. Also, the magnitude of the 

X A11 simulations were performed using Python together with SciPy and PyDDE li- 
braries. 

2 The coefficient of variation is defined as the ratio er/||t|, where a is the standard 
deviation and fi the sample mean. 
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Table 1: Time to reach identification error ranges for parameter 03 (in 
simulation seconds) 



Method 


Identification error 


1% 


0.1% 


0.01% 


0.001% 


Classical Chen 
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1609.8 


3026.9 


4640.3 


r = 
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0.4 


261.5 


612.1 


942.7 


r = 
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10.3 


104.8 


226.7 


308.5 


Extended Chen r = 
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2.5 


58.4 


106.5 


163.8 


r = 
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2.5 


31.1 


70.9 


94.8 


r = 


5 


2.5 


21.6 


43.5 


67.3 



error is reduced by comparison to Chen's method. 

Similar results were obtained using the Rossler attractor. In the form 
of ([T]), it can be written as 



(25) 



where x, y and z are state variables and 0\, 62 and #3 are system parameters. 
The Rossler system was synchronized with a response system specified by 
four parameters. In the form of ([2]), it can be written as 
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(26) 



where u, v and w are state variables and ct\, 02, 03 and 04 are the pa- 
rameters. Again, the rank of the F(x) matrix is 3, while the number of 
parameters is 4. 

For this simulation, the commonly used parameter values for the Rossler 
system were used: [#1, 6*2, #3, 0a\ t = [0.1, 0.1, 14, 0] T . The initial states of 
the drive system and the controlled system were arbitrarily set to [8, 9, 10] T 
and [3, 4, 5] T , respectively. The parameters of the response system had zero 
initial condition. The L and K parameters were set to 10/ and 0.1 1 (for / 
being the identity matrix with appropriate dimensions). 

The improved convergence performance of the proposed method over 
Chen's is clearly visible in Figure [5j while parameter convergence is faster 
for higher values of r. Figure [6] shows the results of parameter identification 
for ai, which, together with «4, specifies the evolution of the state variable 
v. During the last 20 seconds of the experiment, the coefficient of variation 
of the root mean square error is of 2.96 x 10~ 2 for Chen's method, while 
for our method it is of 6.11 x 10" 5 (r = 3) and 3.32 x 10~ 7 (r = 5). Chen's 
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Figure 5: Rossler system: graph of parameter identification results for 04. 
Solid line: Classical Chen, dotted line: Extended Chen (r = 3, dash-dotted 
line: Extended Chen (r = 5). 
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Figure 6: Rossler system: plot of parameter identification results for 0:3. 
Top plot: Classical Chen, middle plot: Extended Chen (r = 3), bottom 
plot: Extended Chen (r = 5). 
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Figure 7: Flossier system: graph of Lyapunov function for synchronization 
error. Top plot: Classical Chen, bottom plot: Extended Chen (r = 3). 

method cannot identify this parameter correctly, with its value oscillating 
around the true value of #3. On the other hand, our method allows for stable 
parameter identification. Again, convergence is faster for greater values of 
r. Finally, Figure [7] shows the synchronization error, as measured by the 
Lyapunov function ([7]). Both methods drive the synchronization error to 
zero, while our method shows a significantly faster convergence. Also, the 
magnitude of the error is reduced by comparison to Chen's method. 

5 Conclusions 

Building upon previous work in simultaneous parameters identification and 
synchronization of dynamical systems, this paper proposes an improved 
method that addresses limitations of the previously published Chen's method 
[3]. The proposed method is capable of handling arbitrarily large parame- 
ter space dimensions. Convergence proof of the method is provided, using 
the Lyapunov's second method. Numerical results illustrate the proposed 
method, comparing it to Chen's and showing better performance in terms 
of both faster and less noisy parameter identification. 
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